We review the steps which have led to the discovery of a widespread population of objects at z = 3 with many of the characteristics which we expect for primeval galaxies, and emphasize in particular the advantages of a colour selection technique which targets the Lyman discontinuity at 912 Angstroms. Star forming galaxies at z = 3 resemble local starbursts, although they are typically more luminous by more than one order of magnitude. The ultraviolet continuum is dominated by the integrated light of O and early B type stars and shows prominent interstellar absorption lines which are often blueshifted relative to the systemic velocity of the galaxy, indicating highly energetic outflows in the interstellar medium. Lyman alpha emission is generally weak, probably as a result of resonant scattering. The spectral slope of the ultraviolet continuum and the strength of the Hbeta emission line, which we have detected in a few cases with pilot observations in the infrared K band, suggest that some interstellar dust is already present in these young galaxies and that it attenuates their UV luminosities by a factor of about 3. The efficiency of our photometric selection technique has allowed us to establish that large scale concentrations of galaxies were already in place at z = 3, possibly the precursors of galaxy clusters as they as they were beginning to decouple from the Hubble expansion. In the context of Cold Dark Matter models of structure formation, the observed clustering of the z~3 galaxies suggests that they are associated with dark matter halos of mass greater than 10^12 solar masses. We conclude by pointing out the need for infrared space observatories, such as the proposed Next Generation Space Telescope, for pushing the quest for the origin of galaxies beyond z=5.